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Maximum Principle for General Controlled 
Systems Driven by Fractional Brownian Motions 

YuECAi Han* Yaozhong Hu^ and Jian Song 



Abstract 

We obtain a maximum principle for stochastic control problem of gen- 
eral controlled stochastic differential systems driven by fractional Brown- 
\) , ian motions (of Hurst parameter H > 1/2). This maximum principle spec- 

^*^ ■ ifies a system of equations that the optimal control must satisfy (neces- 

. ' sary condition for the optimal control). This system of equations consists 

i-i^ , of a backward stochastic differential equation driven by both fractional 

j^ ' Brownian motion and the corresponding underlying standard Brownian 

motion. In addition to this backward equation, the maximum principle 
also involves the Malliavin derivatives. Our approach is to use condition- 
ing and Malliavin calculus. To arrive at our maximum principle we need 
to develop some new results of stochastic analysis of the controlled sys- 
^ ■ tems driven by fractional Brownian motions via fractional calculus. Our 

Cn ' approach of conditioning and Malliavin calculus is also applied to classi- 

cal system driven by standard Brownian motion while the controller has 
only partial information. As a straightforward consequence, the classical 
maximum principle is also deduced in this more natural and simpler way. 



o 

CN ■ 1 Introduction 



Fix a finite time horizon T S (0, oo). Let (fi, J-, P) be a basic probability space 
equipped with a right continuous filtration {Ft)o<t<T satisfying the usual con- 
ditions ([9]). Let B" = {B^{t) , • • • , B^{t) , < < < T) be an m-dimcnsional 
C^ , fractional Brownian motion of Hurst parameter H G [j, 1) (It is straightforward 

except notational complexity to allow H to be different for different fractional 
Brownian motions). This means that B^ [t), j' = 1, 2, • • • , to, are independent, 
continuous, mean Gaussian processes with the following covariance 

E [B^mfis)) = i% (t^^ -f- s'" \t - s^) , (LI) 
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1 if j = 7 . 
where Sij — < 'is the Kroncckcr symbol. 

[0 if i^j 

This process has been apphed in many fields such as hydrology, climatol- 
ogy, economics, internet traffic analysis, finance, and many other fields. The 
stochastic analysis associated with fractional Brownian motions has been exten- 
sively studied recently. The stochastic differential equations driven by fractional 
Brownian motions have also been considered by many researchers through sev- 
eral approaches, see for example, through general rough path analysis [7], [12], 
[16], [25] or through fractional calculus [17], [18], [28]. In particular, we refer to 
the references therein. 

Since stochastic control is a main tool of applications of stochastic analysis 
it is natural to consider the problem of stochastic control of systems driven by 
fractional Brownian motions. Along this direction there have been already some 
work. In [15], [21] (see also [1]) some specific stochastic control problems relevant 
to mathematical finance have been investigated. There is also a general sufficient 
condition of optimal control for general control problems in [20]. The explicit 
optimal linear Markov control was obtained in [22] by using the technique of 
completing squares and by using the Riccati equations. 

However, the problem of optimal control for general stochastic systems 
driven by fractional Brownian motions is far away from being considered as 
resolved. In fact, there has been a lack of necessary conditions in a more gen- 
eral setting. In this paper, we shall fill this gap. More precisely, we shall obtain 
a set of necessary conditions that the optimal control must satisfy. 

The theory of stochastic control of systems driven by standard Brownian mo- 
tions is very rich and has found many applications. There have been mainly two 
general approaches toward the solutions. One is the Hamilton- Jacobi-Bellman 
dynamic programming which results in a highly nonlinear Hamilton- Jacobi- 
Bellman equation. The study of viscosity solutions of this type of equations 
has experienced an explosive growth in recent years. See [11], [35], and the 
references therein for the stochastic control related development. The study of 
viscosity solutions of the nonlinear Hamilton- Jacobi-Bellman equation has be- 
come one main stream of partial differential equations, see [8], [24], and many 
more other references for general discussion. Another approach in stochastic 
control is the Pontryagin's maximum principle. Starting with [4], [5], and [6], 
backward stochastic differential equations (abbreviated as BSDEs) has been 
used to describe the necessary (and sufficient) conditions that the optimal con- 
trol must satisfy. We also refer to [11], [29], [35] and the references therein for 
some other work. 

The approach of Bellman dynamic programming heavily depends on the 
semigroup property of the underlying system (namely, the Markov property of 
the underlying controlled stochastic processes). In fact, one can also obtain the 
Hamilton- Jacobi-Bellman equation for more general Markov processes, see for 
example, [26]. However, the fractional Brownian motions are not Markov except 
in the case of Brownian motion (H = 1/2). Thus, it is natural to concentrate on 
extending the Pontryagin's maximum principle to controlled system driven by 



fractional Brownian motions. The first main task is to find the appropriate back- 
ward stochastic differential equations (an extension of the Riccati equation). In 
this work, we obtain the backward stochastic differential equations in a natural 
way, through the idea of conditioning. This type of backward stochastic differ- 
ential equations involved terms driven both by fractional Brownian motion and 
by the underlying standard Brownian motion. In the classical standard Brown- 
ian motion case, researchers usually obtain this backward stochastic differential 
equation by the duality approach for which one has to know the form of the 
BSDE in advance. Our approach is motivated by a recent work [19] on linear 
BSDE driven by standard Brownian motion by using Malliavin calculus. We 
are excited about this approach since it is very natural: the BSDE is deduced 
naturally without prior knowledge of the form of the BSDE! 

Our approach is also new in the classical setting of the controlled systems 
driven by standard Brownian motions. The advantage of our approach in the 
classical setting of standard Brownian motion is that it also works for stochas- 
tic control with partial information. Thus, we also present our approach to 
deduce the maximum principle in classical case, first with partial information 
and then to give an alternative way to deduce the classical maximum principle 
with complete information. This is done in Section 3. 

To deduce the maximum principle for the controlled stochastic system driven 
by fractional Brownian motions, we need more results on stochastic analysis of 
the controlled systems, which has not been studied yet. In particular, we need 
to have the uniform Holder continuity of the solutions, and the differentiability 
of the solution with respect to the control. These results are of interest them- 
selves. We shall present these new results in Section 4. In Section 5.1, using 
the idea in Section 3, we obtain a necessary condition that the optimal control 
must satisfy when the controller has only partial information. The stochastic 
control problem with partial information is very important in finance, while not 
much theory has been developed yet. However, wc refer to the work [20] (for 
partial information linear quadratic control) and the references therein. Section 
5.2 aims to simplify the condition obtained in Section 5.1 when the controller 
has complete information available. The condition leads naturally to a new type 
of backward stochastic differential equation driven by the underlying standard 
Brownian motion and by the fractional Brownian motion. Besides the complex- 
ity of the BSDE which involves fractional Brownian motion and the underlying 
standard Brownian motion, the system of equations of maximum principle also 
involves the Malliavin derivatives. This system of equations of maximum prin- 
ciple is very complex. However, this is expected since the problem is much more 
complicated now. In the case of controlled system driven by standard Brown- 
ian motion, the theory obviously reduces to the classical maximum principle as 
demonstrated in Section 3. 

To obtain our maximum principle we need some additional results on frac- 
tional calculus and Malliavin calculus. In Section 2, we introduce some notations 
and obtain some new results that we shall use. We also recall some necessary 
notations from [1], [10], [14], [16], [17], and [18] to estabhsh some new results 
for controlled system driven by fractional Brownian motions. In particular we 



shall establish some new important identity which is necessary in our approach. 
It is interesting to have some examples that can be solved by using our 
new maximum principle. However, as it is well-known, the explicit solutions of 
stochastic control are always difficult to obtain even in the classical Brownian 
motion case. See however, [3] for some general discussion. It is expected that 
the problem will be more complex. In addition, this paper is already long. So, 
we shall discuss some particular control problems with this approach in the 
future. 



2 Fractional calculus and Malliavin calculus 

2.1 Fractional calculus 

In this section we recall some results from fractional calculus. Let a,b G ]&. 
with a < b and let a > 0. The left-sided (and right-sided) fractional Riemann- 
Liouville integrals of integrable function / is defined by 

4\/W = TT^ f\t-sr-'f{s)ds, a<t<b, 
r (a) J a 

[and 

r(a) Jt 

respectively], where (—1)"" = e~"^" and F (a) = L r°'~^e~'^dr is the Euler 
gamma function. The Weyl derivatives are defined as 

D:,f it) . -^^ f /% + a f m^I^d^ (2.1) 

and 



(-1)" fit) . [' fit)-/ is) 

r{l-a) l(6-f)"^ J, (s-t)^ 



DUit) = ,^rT^{7^^+-l ',' .Z' d-A (2.2) 



where a <t < b. 

For any (3 e (0, 1), we denote by C^ia, b) the space of /?-H61der continuous 
functions on the interval [a, b]. We will make use of the notation 



Ma.h.R ^ sup 



a<0<r<b \r - t^r 

and 

||a;||a,(,,cx) = sup \Xr\ ■ 

a<.r<.b 

When a and h are clear, then we shall use \\x\\p = ll^lla b Q ^^*^ ll^l 



It is clear that when / S C^{a,b) with /? > a, then both V^j^f [t) and 
D'^_ f (t) exist and we have 



\DZ+f{t)\<C\\fUt-a\P-'^ if /(a)-0 

|^?-/W|<C||/||^|6-ip-" if /(5) = 0. 



(2.3) 



The foUowing fractional integration by parts formula and its consequence 
are needed in the sequel (sec [34] for a proof). 

Proposition 2.1 Suppose that f E C^{a,b) and g G C^{a,b) with X + n > 1. 
Let X > a and fi > 1 — a. Then the Riemann Stieltjes integral J fdg exists and 
it can be expressed as 



fdg = (-1)" / D^+f (t) Dlz'^gt- (t) dt , 



(2.4) 



where gt- (t) = g (t) — g (6). 

From the definition (2.1) of D"_^_f (t) and (2.3), wc have immediately 

Proposition 2.2 Suppose that f G C^{a,b) and g G C^{a,b) with A + /.J > 1. 
Let X > a and ^ > 1 — a. Then the Riemann Stieltjes integral J fdg exists and 



fdg 



+^ll.9ll. r H-'^PrTi^ib^-r^'-'d-dr. (2.5) 



2.2 Stochastic calculus for fractional Brownian motions 

Let {W{t) = {Wi{t),--- ,Wm(t)),0 < i < T) be an m-dimensional standard 
Brownian motion. Let 



ZH{t,s) = KH 

with 

and define 



H-k 



(t-s) 



H-i 



(H-1).^ 



-« / u^-iiu- s)"-^du 
(2.6) 



KH 



I 2HT{§ - H) 

T{H+\)V{2-2H) 



Bf{t) = I Znit, s)dWj{s) , < t < oo . 



(2.7) 



(2.6 



Then from (2.2)-(2.4) of [14] we see that B" [t) = (Bf(i),--- ,B,^(t)),0 < 
i < r) is an m dimensional fractional Brownian motion. This means that 



B¥ (t) , J = 1, • • • , TO are independent Gaussian processes with mean and vari- 
ance given by 

E (Bfm^is)) = Is,, (r^« + .'" \t sn . 

The stochastic integral with respect to _B,^ can be defined in a similar way as 
in [14]. We shall use the results in [14]. 

Recall the operators TT'^ j. and BJ^j, (see the equations (5.21) and (5.35) of 
[14]) 

1 1 /"^ 1 

T*HTf{t) ■.= {H--)KHt^~" u"-^u-t)"~^f{u)du, 0<i<r. (2.9) 

2 Jf 



and 



^krfit) 



2HK1 1 TT 



dt 



where kh is defined in (2.7) and 

Ki = 



{u-t)^'"u"-^f{u)du, 



1 



(2.10) 



2HT{H-\)TU-H) 



Let ^1, • • • , ^fc, • • ■ be an ONB of L'^{[Q,T]) such that ^fc, fc == 1, 2, • • • are 
smooth functions on [0, T]. We denote S,j,i = /q £,j{t)dWi{t) , where j = 1, 2, • • • , 
and / = 1, • • • , TO. Let V be the set of all polynomials of the standard Brownian 
motion W over interval [0,T]. Namely, V contains all elements of the form 

(2.11) 



where / is a polynomial of n variables. If F is of the above form (2.11), then 
its Malliavin derivative DsF is defined as 



For any F G V, wc denote the following norm 

E 



{h=i} 



0< s <T. 



(2.12) 



IF! 



i,p •= 



li^il 



(=1 



E 



p/2 



[OT] 



D\F\'^dt 



i/p 



It is easy to check that || • || i.p is a norm p e (1, oo). Let Di^p denote the Banach 
space obtained by completing V under the norm || ■ ||i,p. We can certainly define 
the higher derivatives. But we only need the first derivatives in this paper. 
For the above ^^'s we can define r]j = B^ j.^j and we denote by V^ the set 

of all polynomial functionals of t)j,i := /^ rij{t)dBp [t). For an element G in V^ 
of the following form 



G(w) =g{fij,M ,••• ,%„,;„) , 



(2.13) 



where g is a polynomial of n variables we define its Malliavin derivative D^'^G 

by 

^f''G = Eaf fe.'i'---'^^".'")'?J-.(«)^{'.=0' 0<s<T. (2.14) 

z— 1 

Similarly, we can define || • |lff,i,p and '^H,i.p- 

For fractional Brownian motions, another different Malliavin derivative is 
also very useful. 



\G^ I (j){s-r)D^'^Gdr, 
'o 



where 

(j){s) = H{2H -l)\s\'^"-^ , 0<s<T. 

It is well-known from ([14], Theorem 6.23) that 



(2.15) 
(2.16) 



Proposition 2.3 Let tp : [0,T] ® {il,J^,P^) — )■ M be jointly measurable and let 
F e Dh,i2- Then 



e\f ^tdBf{t) 



E 



TP,F 



tpt]dt 



(2.17) 



The following proposition from ([10], Theorem 3.9) will also be used in this the 
sequel. 

Proposition 2.4 Let tp be a jointly measurable stochastic process which has 
Malliavin derivative and let the following hold: 



E 



b rb 



|7/'s'0t|0(s — t)dsdt 



b nb 



sil]t\ dsdt 



< oo . 



ip{t)d° Bf {t) = 4^{t)dBf{t)+ Bl'iP{t)dt. (2.18) 



The 



The following proposition is easy consequence of the above identity (2.17) and 
the relation between path-wise integral and the stochastic integral obtained by 
using the Wick product (2.18). 

Proposition 2.5 If F satisfies the condition in Proposition 2.3 and ip satisfies 
the conditions in Propositions 2.3 and 2.4, then 



E J F y 4Hd°Bf{t) [ = / E (bI [FiPt 



dt. 



(2.19) 



If F is a nice functional of the fractional Brownian motions B^ = {B^ , • • • , B^), 
then it is also a functional of standard Brownian motions W = {Wi, ■ ■ ■ , Wm)- 
So for this F we can compute both the Malliavin derivatives D^ and D^'K The 
relation between these two Malliavin derivatives arc useful later in this paper. 
Next, we shall find this relation. 

If / is a nice function on [0, T], then J^ f{t)dWj{t) and J^ f{t)dBf{t) are 
well-defined and from page 45 of [14], we have 

f{t)dBf{t)^ I {T*H^Tf){t)dW,{t) 



and 

i-T i-T 



^0 



!{t)dw,{t)= / {W„T!){t)dBf{t)., 



where T*^j, and BJ^ ^ are defined by (2.9) and (2.10). If F is given by (2.11), 
then F can also be represented by 

F^f ij\M*H^TinmdB?Ai) > ' ' ' , j\wH^Ti,^){t)dBfl{t)\ . 

Thus as a functional oi B^ , its Malliavin derivative DgF is defined as 

D"'P = EI^n"^ (»kTOJ(t)d<(t),---,^'^(Bl,,^^,J(i)di?,f(i)j 

Thus for F e T', we have 

JjH,lp ^ M*htD^.F{s) 
2Hki 



-s^-"— / {u ~ s)^-"u"-i DlFdu 
as Js 



[F = -^E!ilH{2H-l) I s-^-"\t-s\'f^-^i^ I {u-s)-^-"u"--^DlFdu]ds. 



KH 

and 

By a limiting argument, we have the following 
Proposition 2.6 //F e Di,p nB^.i^p, then 

KH ds J^ 



iF = c,,H Ts^-^lt-sr-' 
Jo 



i— {u~s)^~"u^~^DlFdu\ds, 



(2.21) 
where ci,h = ^- —'-■ 



K,H 



Proposition 2.7 Let Ft = E" i /q fj{s)dBf{s) andGt = Ej^i /o 5j(s)dW,(s), 
where /i, • • • , /m satisfy the conditions in Proposition 2.4 and let gi,- ■ ■ ,gm be 
continuous adapted processes. Then 

d{FtGt) = FdGt + GtdFt . (2.22) 

Proof Wc can prove this proposition in the same way as the proof for Theorem 
2.1 of [22]. ■ 

3 Systems driven by Brownian motions 

In this section, we shall use our approach of conditioning and Malhavin calculus 
to deduce the maximum principle for partially observed controlled system driven 
by standard Brownian motions. The complete information case will also be 
deduced. In this classical case, our approach seems to be new, straightforward 
and simpler. 

3.1 General stochastic control with partial information 

In this subsection we shall obtain a maximum principle when only partial infor- 
mation is available. This means that the control Ut may not necessarily depends 
on full information determined by the Brownian motions {W{t) : Q < t <T}. 
We assume in this subsection that (^t)o<t<T ^^ ^'^y right continuous filtration 
which is contained in the a-algebra {J-^t)o<t<T generated by {VK(t) : < t < T}. 
The space of admissible controls is defined as 

U[0,T] ^ |u : [0,T] X il ^ M'' I u is t^-adapted stochastic process 

\u{t)\^dt\ < +oo|. 

To describe our stochastic control problem, we need to introduce four func- 
tions b, (7, I, and h. They are assumed to satisfy the following conditions. 

(HI) The functions b : [0,T] x M" x R'' ^ W\ a = (ct\ • • • ,a"') : [0,T] x 
K" X K'' — >• R"^™, and /i : K" — >• K are continuous with respect variables 
t, X, and u and are continuously differentiable with respect to x, u for all 

ie[o,T]. 

Denote 

, ,. N fdbi{t,x,u)\ fdb,{t,x,u) 

ba:(t,X,u)^[ , bu(t,X,u)=' 




\ ^^3 J l<i.j<n \ ^^J / l<i<n,l<3<d 

(H2) We assume that there is a constant C > such that 

ra m 

sup \b^{t,x,u)\ + \bu{t,x,u)\+y2Wiit,x,u)\+^\ai{t,x,u)\ < G . 

tG[0,T],xeR",ueR<' j^i j^i 



(H3) We assume that Z : [0, T] x M" x R'' ^ R and /i : M" ^ R be continuously 
differentiable with bounded derivatives. 

[In what follows throughout this paper, we shall use C to denote a generic 
constant which may have different value at different occurrences.] 

The controlled stochastic control system is described as the following stochas- 
tic differential equation: 

m 

dx{t) - b{t,x{t),u{t))dt+Y.(^Kt'.<t)Mt))dW,[t), 

3 = 1 (•^•J^J 

a;(0) ^ xq, 

where xq is a given vector in R". For a given u G f/[0,T] the existence and 
uniqueness of the solution x" {t) to the above equation follows from standard 
theory of stochastic differential equations. For simplicity, we sometimes omit 
the explicit dependence of x{t) on u, namely, wc write x{t) = x"(t). The cost 
functional wc shall deal with is 

J{u{-)) = J(x"(-), u{-)) =Af Kt, x^t),u{t))dt + /i(a-"(r)) I . (3.2) 

The first optimal control problem studied in this paper is to minimize the 
cost functional J{u{-)) over t/[0, T]. This means that we want to find the optimal 
control u*{-) € U[0,T] satisfying 

J(u*(-))= inf JM-)). (3.3) 

u{-)euio.T] 

If such an optimal control u*{-) exists, then the corresponding state x*{-) = 
x^ (•) is called an optimal state process, {x* {■) , u* {■)) is called an optimal pair 
for the optimal control problem described by (3.1), (3.2) and (3.3). 

Assume (x* {■) , u* {■)) is an optimal pair. Namely, J(u(-)) attains its mini- 
mum at u*{-). From the general theory of functional analysis, we know that u*{-) 
is a critical point of J(u(-)). We are interested in finding a necessary condition 
satisfied by (V(-),u*(-)). For any e e Mandw(-) € C/[0,T], let u^(-) = u*+ev{-). 
It is easy to see that m^(-) 6 C/[0,T], and there is a unique a;'^(-) satisfying the 
state equations (3.1) with control u replaced by u^(-). 

Denote 

bUt) = 6,(i,x*(i),w*(i)), bl{t)=b^{t,x*{t),u*{t)), 
4'^t) = ar{t,x*{t),u*{t)), a=^%t)^or{t,x*(t),u*(t)). (3.4) 

The following lemma can be proved easily and it is necessary in obtaining the 
maximum principle for the stochastic control problem (3.1)-(3.3). 



e-)-0 

following equations: 



Lemma 3.1 The limit y(t) = lim ^^-^ — E_Li exists in L^ and yit) satisfies the 



dy{t) = [b%{t)y{t) + bi{t)v{t)]dt + Y.[<yii*{t)y{t) + <yii*{t)v{t)]dw,{t), 

J=i (3.5) 

2/(0) = 0. 



10 



We need to solve the above linear stochastic differential equations (with random 
coefficients). In particular, we need to express y in an explicit form of v. For 
this reason we consider the following linear matrix- valued stochastic differential 
equations. 



d$(t) = bi{t)^{t)dt+Y.^r{tmt)dw,{t), 

$(0) = /, 



(3.6) 



From the basic theory of stochastic differential equations, it is well-known that 
this equation has a unique solution, denoted by $(i). It is easy to verify that 
4>~^(t) exists and is the unique solution of the following stochastic differential 
equations ([35]): 

Cm „ \ 771 

$-1(0) ^ I. 

From the Ito's formula we can obtain the solution of the equation (3.5) by 
using $(t),$"i(t). 



v{t) 



<^{t) / '^-\s){hl{s)~a:{s)al{s))v{s)ds 

I 

Y^Ht) <^-\s)ali*{s)v{s)dW,{s)., 



(3.8) 



where 






(3.9) 



Since u*{-) is an optimal control, it is a critical point of the functional J{u{-)), 
namely, we have 



J{u*{-)+sv{-)) 
de 



But 



= 0. 



(3.10) 



e=0 



-J(u*{-)+sv{-)) 



= E 



6 = 



{l*J{t)y{t) + l*J{t)v{t)) dt]+E {hJ{x*iT))y{T)) 



11 



Using (3.8) for the solution y{t), we have 



-Jiu*{-)+evi-)) 



rjmit) 



e=0 
t 



<i>-Hs){b:{s)-<J:{s)a:{s))v{s)ds 



l*J{t)vit)]dt 



hl{x*{T)MT) 



'^-\s)ai;*is)v{s)dW,i.s) 



dt 






^-\s){bl{s)^a:{s)a:{s))v{s)ds 



^-\s)al:*{s)v{s)dW,{s) 



Now we make use of the following identity from Malliavin calculus: 

^{pj g{t)dWj{t)\ ^^ j (DlF)g{t)dt. 
Combining this identity and Fubini type theorem, we have 



J{u*[-)+ev{-)) 
de 



e=0 



rj {t)^{t)^-\s){bl{s) - a:{s)al{s))v{s)dt ds 



l*J{s)v{s)ds + E f hJ{x*{T)MT)<^-\s)ibl{s) - a;is)a:{s)Hs)ds 



(3.11) 



+ EE / Di{hJ{x*{T)MT))^-\s)<jr{s)v{s)ds. 

Denote 

^{T,s) := i[i:^{tmt)dt\'^-\s){hl{s)-a:{s)al{s))+rj{s) 

+ E ([ D's {l*Jmit)dt) '^-\s)ar{s) + Dl {hJ{x*iT))MT)) <i>-i(s)<^*(s) j 
+hJ{x*{T)MT)^-\s){b:{s) a:{s)a:{s)). (3.12) 



12 



Then from (3.10) and (3.11) we have 



de 



Jiu*i-)+evi-)) 



e=0 



E 



E 



*(r,s)v(s)ds 



E{'${T,s)\gs}v{s)ds 



0. 



Since the above identity holds true for all {Gt)o<t<T adapted process v S U[0, T], 
we have 

E{*(T,s)|e4 =0 VO<s<T. (3.13) 

We can also write the above equation as 

E{*(r,s)T|g,} =0 VO<s<T. (3.14) 

Denote E^*(X) = E {Xl^t}. Then we can state (3.14) as the following general 
maximum principle (e.g. the equation (3.15) below). 

Theorem 3.2 Let (x* {■) , u* (■)) be an optimal pair of the control problem (3.1)- 
(3.3). Define 

{ Pit) = ^^-\t)j^<^-^isms)ds + ^^-'m^iT)h,ix*iT)), 

\ Q,{t) = -ar(i)P(t) + <i>^"'(t)A($^(r)/j,(.T*(r)))+/f A($^(s);*(s))ds. 

Then 



W 



b*Jit)P{t)+Y.ai;*^{t)Q,{t) + i:{t) 



= y te[0,T] (3.15) 



almost surely. 



3.2 Stochastic control with complete information 

If J"( = a{Wi{s) , • • • ,W,n{s) ,0 < s < i) is the cr-algebra generated by the 
Brownian motion W{s) — {Wi{s) , • • • , W^m(s)), then the above equation (3.15) 
for the maximum principle can be simplified. 

First note that 6*^(t), cri'*^(t), • • • , cri'*^(i), and Z*(t) are J"t-adapted, then 
the equation (3.15) can be written as 

m 

b*J{t)p{t) + Y.ai:*^ it)q,{t) + ll{t) = V t e [0,r] , (3.16) 

J=l 

where we denote p{t) = E-^' [P{t)] and qj{t) = E-^* [Qj{t)\- From the definition 
of P{t) and Qj{t), we have 

Pit) = <i>^'\t)E^*[j^'^^{.s)l*J.s)ds + <i>'^{T)h,ix*iT)) , 
qjit) = ~{<Ji'*it))pit) + ^^-\t)E^^\Dt{<P^iT)h,{x*iT))) (3.17) 



j;'D,{<P^is)l*{s))ds 



j = !,■■■ ,m. 
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Lemma 3.3 If p{t) and qj{t) are defined as above, then 

q,{t)^Dlp{t). (3.18) 

Proof From (3.7) we see that 

Di<^-\t) = -<^-\t)<jr{t) . 

On the other hand, from Proposition 1.2.8 of [27], we see that 

This proves the lemma easily. ■ 

From the equation (2.11) of [19], we see that p{t) and {qi{t) , • • • , qm{t)) is 
the unique solution of the following backward stochastic differential equations. 

■m m 

~dp{t) = {b*J{t)p{t) + E ai;*^{t)q,{t) + l*{t))dt - E q,{t)dW,{t) 

j=i 3=1 (3.iyj 

p{T) = K{x*{T)). 

Theorem 3.4 Let (x* {■) , u* {■)) he an optimal pair of the control problem (3.1)- 
(3.3). Letpit) and {qi(t),- ■ ■ ,q,„(t)) be the unique solution pair to (3.19). Then 

m 

b*J{t)pit) + E ^i*^(*)9,(t) + lUt) =0 y te[0,T] (3.20) 

almost surely. 

Remark 3.5 The equations (3.1), (3.19), and (3.20) is a system of coupled 
forward-backward stochastic differential equations. Usually they can be used to 
determine the optimal control u* and the corresponding optimal state x* . For 
the convenience we can write them together as 

m 

dx*{t) ^b{t,x*{t),u*(t))dt+ J2 o-^{t,x*{t),u*(t))dWj{t), 
x*iO)=xo, 

m 771 

-dp{t) = ib*Jit)pit) + Y: ai^*^it)q,it) + l*it))dt - E q,it)dW,{t) , 
piT)^h,ix*iT)) 

ra 

(3.21) 
where < t < T. 

The system of coupled forward-backward stochastic differential equations (3.1), 
(3.19), and (3.20) can also be written by using the so-called Hamiltonian. Let 

m 

H{t,x,u,p,q) :— b[t,x,u) p{t) + 2,^''' {t,x,u)qj(t) + l{t,x,u), 
(i, X, u,p, q) e [0, T] X R" X M'' X M" X K"^™ . 
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Then the maximum principle (3.21) can be restated as 

dx*it) = —H{t,x*it),u*{t),pit),qit))dt + Y,Q-H{t,x*it),u*it),pit),q{t))dWj{t) 



x*(0) = a:;o 
dx 



-dpit) = —H{t,x*it),u*{t),pit),q{t))dt -J2<lAt)dW,it) 



p{T)^h,{x*iT)) 

^H{t,x*{t),u*{t),pit),qit)) = , 
y ou 

(3.22) 

where < i < T. 



4 Controlled stochastic differential systems driven 
by fractional Brownian motions 

To obtain our main resuhs of maximum principle for the system driven by 
fractional Brownian motions, we need to develop some new results for controlled 
stochastic differential equations driven by fractional Brownian motions. Let 
us recah that B" it) = (Bf(i),--- ,B^{t)),0 < i < T, is an m-dimensional 
Brownian motion. Let (Qt ,0 < t <T) he a right continuous filtration contained 
in the filtration (J^t , < ^ < 7") generated by fractional Brownian motions 
B"{t). 

First, let us define our space of admissible controls: 

C/[0, T] := i u\u :[0,T]xn^ R'', ^-adapted, u € C^[0, T] for some fi > 1 - H , 

there exist constant C > 0, c > 0, and (3 < H 
such that ||m||^,o,t < Ce''^T=i \\Bf\\p,o.T 

and I I E(|Dfu(i)p)dsdi<cx)i. (4.1) 

Consider the following controlled stochastic differential equation driven by frac- 
tional Brownian motion: 




b{t,x{t),u{t))dt+ J2 (j\t,x{t),u{t))d°Bf{t), 



i=i 



(4.2) 



Here the integral with respect to fractional Brownian motion is in the pathwise 
sense (or the Stratonovich type integral). 

We assume that b : [0, T]xW xW^ ^ K", a : [0, T] x M" xW^ ^ M"^" are 
some given continuous functions satisfying the following conditions. 
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(H4) b{t, X, u) is continuously difFerentiable with respect to x and u. Moreover, 
there exists a constant L such that the foUowing properties hold: 

\bx{t, x,u)\ + \bu{t, x,u)\ < L, 

\bx{t, X, u) - bx{t, y,v)\ + \bu{t, x, u) - fo„(i, y,v)\ < L{\x - y\ + \u ~ v\) , 
Vx eM", V ueM.'^, Vie[0,T]. (4.3) 

(H5) cr(i, X, u) is twice continuously differentiable in x and u and there exist 
some constants 1 — _ff < 7 < 1 and < S < 1, and L such that for each 
i = 1, • • • ,n: 

(i) The partial derivatives of a with respect to x and u are bounded: 

\axit,x,u)\ + \auit,x,u)\ < L, 
\axx{t,x,u)\ + \auu{t,x,u)\+axu{t,x,u)\ < L. 

(ii) Holder continuity in time: Va; S ]R",-u S R,Vt,.s G [0,r], 

|cr(i, X, u) — a(s, x,u)\ + |i9^cr(t, x, u) — dx<j{s, x, u)\ 
+ \du<y{t,x,u) - ducr{s,x,u)\ + \axxit,x,u) - axxis,x,u)\ 
+ \crxu{t,x,u) - axu{s,x,u)\ + |(T„„(i,x,u) - cr„„(s,x,w)| < L\t - s^. 

(iii) Lipschitz continuity of second derivatives with respect to state and 
control variables. 

\auu{t,x,u) - (Tuu{t,y,v)\ + \axu{t,x,u) - axu(t,y,v)\ 
< L{\x-y\ + \u-v\) . 

If b and a satisfy the above assumptions (H4) and (H5) and if u is an 
admissible control, then the coefficients b{t,x) = b{t,u{t),x) and a{t,x) = 
a{t,u{t),x) satisfy the conditions {Hi), {H2), and (H^) of [28]. Thus it follows 
that for any admissible control u, the controlled stochastic differential equation 
(4.2) has a unique solution (see also [17]), denoted by x". Moreover, for any 
1 — H < a < 1/2, the solution is 1 — a Holder continuous almost surely, namely, 
\x{r) — x{t)\ < co|r — t\^~" almost surely (where cq may depends on B^). The 
solution x" of above equation (4.2) depends on u. But to simplify the notation 
we often omit its explicit dependence on u and write xt = x". 

Let u* and v be two admissible controls. Denote w = v ~ u*. For any 
£ g M, we denote u^ = u* + eu. Then u and u'^ are also admissible controls. 
Corresponding to u* and u!^ there are solutions x^{-) = x(-;u^(-)) and x*{-) = 
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a;(-; «*(•)) to the equations (4.2) . That is 

x*{t) — xo+ b{s,x*{s),u*{s))ds + y^ / aj{s,x*{s),u*{s))dBj (s), 

(4.4) 

pt rn „t 

x'it) = xo+ b{s,x''{s),u''{s))ds + y2 (Jj{s,x''{s),u''{s))dBf {s) . 
Jo j^i Jo 

(4.5) 
To obtain our results of maximum principle, we need the following. 

Proposition 4.1 Assume (H4) and (H5). Let x^{-) and x*{-) he the solutions 
oj equation (4-2) corresponding tou'^{-) andu*{-) respectively. Then 

lim sup \x%t)-x*{t)\ = 0, 

^^Oo<t<T 



lim sup 



^1(^1^^ -,(t) 



'-^Oo<t<T 

almost surely as £ — > 0, where y{t) is the solution of the following equation. 

yit) = I [bl{s)y{s) + hl{s)u{s)]ds 
Jo 

pt "1 
+ / E H*{s)y{s) + ai*{s)u{s)\ d°Bf{s). (4.6) 

Proof of Proposition 4-1 We shall follow the idea of [17] to prove the above 
lemma. Fix i > a > and ^ > such that 0<l-a<l3<H. Let 
gi{t) , ■ ■ ■ , g-mit) be any given functions of /3- Holder continuous. Consider the 
following deterministic differential equation 

/■t m pt 

x{t) ^ Xq + / b{s,x{s),u{s))ds + y^ / aj{s,x{s),u{s))dgj{s) . (4.7) 

Jo j^-^ Jo 

Corresponding to the admissible controls u* and u^, the above equation (4.7) 
has also two solutions, still denoted by x* and x'^ . Corresponding to m^, we shall 
obtain an equations depending on a parameter e. We can consider more general 
one: 

rt "I pt 

x''{t)=xo+ b{e,s,x%s))ds + ^^ aj{e,s,x''{s))dgj{s) . (4.8) 

Jo j^^ Jo 

Lemma 4.2 Let b{e, t, •) : R" -^ R" and aj{e, t, •) : R" -^ K", j = !,■■■ ,m, 
be a continuously differentiable functions with uniformly bounded derivatives. 
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Let crj(e, •, x) : [0, T] — ^ M", j ^ 1, ■ ■ ■ ,m, be uniformly Holder continuous with 
exponent 7 > a. That means that there is a constant M £ (0, 00), independent 
ofe,t, and X, such that 



_d_ 
dxi 



bj{e,t,x] 



< M , 



_d_ 

dx, 



aj{e,t,x) 



<M 



and 



\aj{e,t,x) — a-j{e, s,x)\ < M\t — s^ . 
Assume also that b and aj satisfy the following uniform linear growth condition: 

\b,{e,t,x)\<M{l + \x\), I a,(e,i,x)|<M(l + |x|). 

Then there are constants C and c independent of e, M , and g, such that for all 
T, 



and 



sup \x'{t)\ <Ce'^ll3"o^r^f(|xo| + l) 

0<t<T 



li2:1|o,T,/J<Ce'=ll5ilo^,.(|2;o| + l) 



(4.9) 



(4.10) 



> 



Remark 4.3 We also have thatKsupQ^^^rp \x'^{t)\P andE\\x^\\^ rj^ „ for any p 
are uniformly bounded (independent of e), when g ~ B^ and ^ < /S < H, by 
Fernique theorem. Actually, since 4 < 2, then by Fernique theorem, we have 

]EePl|B''llo'!T.3 < 00 for allp> 0. 

Proof The existence of the solution x"^ for every e is known. Sec example in 
[17] and [28]. We shall sketch the proof of the bounds (4.9) following idea in 
the proof of Theorem 3.1 of [17]. Without loss of generality we assume that 
n = m = 1. Set \\g\\p = \\g\\o,T,i3- We can assume that IJ^H^ > 0, otherwise the 
inequalities are obvious. 

Step 1. From (2.5), we have for any < s < t < T 



a{e,r,x^{r))dgr 



< C\\g\\p 



\a{er,x^{r))\ ,^^ 

(r — s)" 



|cr(e,r,a;'^(r))-cr(e,T,a;^(T))| 



la+l 



it-rY+^-^drdr 



= : h 



h, 



(4.11) 



where and in what follows, C is a universal constant (independent g and M). 
It is easy to see from the assumption of the lemma that 



h < CM\\g\\p[l + \\x'\U,t^o.]it - sf . 



(4.12) 
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/2 can be estimated as 



h < C\\gy 



\a{e,r,x%r)) - a{e,T,x^{r))\ 



\a+l 



it-rY+P-'drdr 



|cr(e,T,a;^(r)) - cr(e, r, a;'^(r))| 



|a+l 



{t - rY+f^-^drdr 



< CM\\g\\^ [{t sr + \\x'\\s,tAt - s)1 it sf 



On the other hand 
ft 



b{e,r,x^{r))dr 



<CM{l + \\x'\\,^t,oo){t-s). 



(4.13) 



(4.14) 



Therefore from (4.11)-(4.14) we see that the solution x^ to (4.8) satisfies 

\\x%,t,0 < CM [l + 11x^11,,, J +CA/||.g||/3 [l + llx^L,,,^ + \\x'\\s,tAt - sf] . for *.* ^ [0,^] , 

(4.15) 
Step 2. Choose A such that 



(4.16) 



^3CM[l + ||g||^ 
Then, for all s and t such that 0<i — s<Awe have 

Therefore, when <t — s < A 

3 



(4.17) 



\x%t)\ < \x^{s)\ + -CM[l + \\gy] (l + Wx'h^.^Jj A^ (4.18) 



or 



II^IIm.oo < \x^s)\ + -CM[l + \\g\\p] (l + \\x^\^,Jl 
for < t — s < A. Using again (4.16) we get 

\\x^\^^,^^<2\x%s)\+3CM[l + \\g\\0]A^ 
Since (4.16) implies 

A< 
Then 






Hence, 



sup |a;^(r)|<2 sup |x^(r)| + 1 ) Vi-s<A,0<s<t<T. (4.19) 

0<r<t \0<r<s 
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Now we divide the interval [0, T] into n = [T/A] + 1 subintcrvals, and use the 
estimate (4.19) in every interval to obtain 

sup \x^t)\ < 2" (|x^(0)| + 1) < 2^+1 (|:r-'(0)| + 1) . 

0<t<T 

Finally, we have from (4.16) 

1 

sup \x'{t)\ <Ce^ll9lloV.«(|x''(0)| + l). 

0<t<T 

Step 3. From Equation (4.17), we see also when t — s < A and < s < t < T 

\\x'\\s,t.i3 < Ce^^*'*"»"<?T„8(|a;^(o)| + 1) (4.20) 

since x < Ce"^^ , V a; > with some constants c and C For general < s < 
t < T, wc denote s = Iq < t^ < ■ ■ ■ < i„_i < t^ ^ t so that t^ — t^^i < A. 
Then 



x^{t)-x%s) 



{t-sy 



< 



n-1 

E 



fc=0 
n-1 



X%tk+l) -X^tk) 



(tfc+1 - tk)^ 

1 

< ^Ce"ll9ll<^T,^(|a;S (0)1 + 1) 



fe=0 

1 
< nCe'=ll»ll'?T,^(|:E'^(o)| + l). 

With the same argument as (4.20), we have (4.10). The proof of the theorem is 
now complete. ■ 

It is clear that the Proposition 4.1 is a consequence of the following lemma. 

Lemma 4.4 Assume (H4) and (H5) and assume 0<1 — fj,<l — a<l3<H. 

Let gi{t), ■ ■ ■ , gmit) be j3-Hdlder continuous functions of t Cz [0,T]. Let x'^{-) 
and x*(-) be the solutions of equations (4-7) corresponding to u^{-) and u*(-), 
respectively. Then 

lime^o sup \x'^{t) - x*{t)\ =0, 
a<t<T 



linie^o II a;^ - a;*||i-Q = 0, 



lime_>o sup 

0<t<T 



x^[t)-x*{t) 



-y{t) 



0, 



where y{t) is the solution of the following linear equation. 



t ™ 



yit)= / ms)y{s)+blisMs)]ds+ / Y.[ai*{s)y{s)+a^>{s)u{s)]dg,{s 



i=i 



Moreover, the above limits hold in L^ sense as well for all p > 0. 



(4.21) 
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Proof We follow the idea of [17]. We divide the proof into several steps. 

Step 1. To simplify the notation, we assume n = d = m = 1. The general case 
only increases the notational complexity. Throughout this paper we shall use C 
to denote a generic constant, independent of e, whose values may be different in 
different occurrences. Denote cr(-,x^(-), w^(-)) and a{-,x*{-),u*{-)) by cr^(-) and 
(T*(-) respectively. Set y^(-) = a;^(-) - x*{-). We have that 



\f{t)-y^{s)\ < 



{¥{r)-h*{r))dr 



[a'{r)-a*{r)]dg{r) 



\y'^{r)\dr + eL I \u{r)\dr 



< L 



< L \y'{r)\dr + eL \u{r)\dr + h + h , 



+k\\9\\p / (i - rT^^-' [D'^+{^'{r) - a* {r)] dr 



(4.22) 



where 
h 



'^hhfit-rr-^-^^^^^^^dr 



khh 



/i is handled easily. 



^ ' (r - r)"+i 



h < C\\g\\pJ^ ^— p dr + Ce\\ghJ^ ^-^^^ dr. 

< C\\gy{t^sf sup \f{r)\+Ce\\gy{t-sf, (4.23) 

s<r<t 
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Step 2. To estimate I2, let us consider the integral in J2, denoted by l2- 



h ■■ = 



\l^l^!!+i l^'M - 'y*[r) - [a^{r) - a* {t)]\ drdr 



s J s 



{t-rf 



s J s 

1 



(r - r)"+i 



ax{r,x*{r) + Xy" {r),u'' {r))dX • 2/^(r) 



+ / cFuir,x*{r),u*{r) + X{u'^{r) — u*{r)))d\ ■ {u^{r) ~ u*{r)) 



a,{T,x*{T) + Xy'{T),u%T))dX-y'{T) 



au{T,x*{T),u*{T) + X{u'{t) - u*{T)))dX ■ {u'{t) - u*{t)) 



drdr 



(t-r) 



a+l3-l 



(r - r)" 



+1 



a,(r, x*ir) + Xy%r),u%r))dX ■ [y%r) ~ y^r)] 







+ / [a,{r, x*{r) + Xy'{r), u%r)) - <j.,{t, x*{t) + Xy'ir), u' {T))]dX ■ fir) 
Jo 

+ / cru{r,x*{r),u*{r) + Xeu{r))dX ■ e{u{r) — u{t)) 
Ja 

+ / [(7ti(r, x*(r),u*(r) + AeM(r)) — CT„(r, x*(r),u*(T) + Aew(r))](iA • ew(r) 
"'0 

Since a^ and au are bounded, we have 

I2 < C I I ^- L^-^\y^r)-y^{r)\dTdr 



drdr . 



]a+l 



-Ce 



t /•'■(i-r)"+^-i 



+ 



it-r) 



s J s 



(r-r)"+i io 



(t-r) 



Q+,3-1 /•! 



^Q + 1 



I CTx (r, a;* (r ) + Xy' (r) , w" (r) ) - cr^r (r, x* (r) + Ay^ (r) , u" (r) ) | 

dX-\y''(T)\dTdr 
au{r,x*{r),u*{r) + Xeu{r)) - cr„(r, a;*(r),M*(r) + AeM(r))| 

dX ■ e\u{T)\dTdr . 



+ \au{T,x*{r),u*{r) + Xeu{r)) - a„(T,a;*(T),M*(T) + Aeu(r))| 



Again since the second derivatives axx, ctuu, and a^u are bounded and the first 
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\rJr)'^+i \y'ir)-y'ir)\drdr 



derivatives a^. and cr„ are 7-H61der continuous in t, we have 

/. < c r n'-^^'-^'-' 

J s J s 

+CejJ^ \^_l^^^, Hr) - uir)\drdr 
+C I I -, '—^■[{r-r)-< + \x*{r)^x*{r 



(r - t)"+i 
+ |x"(r) - a;^(T)| + \u^{r) - w'^(t)|] • |y"(T)|dTdr 

+ |M*(r) - u*(t)| + |u"(r) - m^(t)|] • \u{T)\dTdr . 



-Ce 



Since both u and w are admissible controls, they are Holder continuous of order 
(/x. Thus u'^ is uniformly Holder continuous of order /x. From Lemma 4.2, we 
know that x^ is also uniformly Holder continuous of order j3 and hence x^ is 
also uniformly Holder continuous of order 1 — a 

Wc also use the boundedness of u. Hence, wc have 



h < C 



* r (± - r.^"+/3-l 



{t-r) 



.^-—^-^\y-{r)~f{T)\dTdr 



+C 



s J s 



{t-r) 



(^_;)^+i [{r rr + {r- r^'-'^^ + {r - r^y^ {T)\dTdr 



-Ce 



t .r (^ _ ^)a+/3-i 



< C 









s 'J s 
t nr 



{r-T) 



2q 



\y^\\l-a,T,rdTdr 



-^ /' f T^T^^^^K'- - rV + (r - r)(i-") + (r - r)^]|y-(r)Mrdr 



S "' s 



-Ce 



(i-0^ 



\^_^Y+i [(^ - ^)'' + ('^ - ^)^ ^"^ + ('^ - ^)'']^^^'' ■ 

Denote v = (1 — a) A 7 A /i. The above inequality gives 

Therefore, we have 

h < C\\gy [{t - s)i+^-"||2/^||i_„,.,, + {t- s)'^+nb1iM.oo + e{t - sf+''] . 

(4.24) 
Combining (4.23) and (4.24), we have 



\fit)-y%s)\ < c\\gy 



(i-s)^+'^-"lly11i-«.s,* + (i-s)'^lly1U,* 



0\\„^\' 



-e{t-s) 



(4.25) 
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Thus we have 

\\y'\\i-c.,s,t < C\\gh 



\\fh^^^,At-^r + it-sr+''-'\\y'h,t 



+e{t~sf+''-^ 



(4.26) 



Step 3. We choose Ai such that 



CWghAf^^. 

From the above equation (4.26) it follows that if < t — s < Ai, then 

\\y'\\i-c..s,t < C\\gy{t - sr+^-'\\y%^t,^ + Ce\\gy{t - 8^+^-' . 
Since \y{t)\ < \y{s)\ + \t — s|"'^^"||y||i-Q.s,i, the above inequality yields 
\y'{t)\ <\y^s)\+C\\gh{t-s)"\\y'\\s^t,^ + Ce\\gh{t~s) ^ , VO<i-,s<Ai 



which implies easily 



\\y%,t.oo<\y%s)\+C\\g\\p{t-sr\\y%,t.oo+Ce\\g\\pit-s)^, VO<t-,s< Ai. 

(4.27) 



Now we choose A2 such that 



C\\ghA'i^l/2. 



[Notice that the constant C may be different than that in the definition for Ai.] 
Then for all < s < t < T, i — s < Ag := Ai A A2, we have from equation 

(4.27), 

\y'Us,t < 2\y^.s)\ + CeWgyit - sf . (4.28) 

We apply the above inequality to s = and t — s < Aq and notice that y'{0) = 0. 
We have that 

\y'kAo,oo<Cs\\g\\,3A^,. 

In general, for any integer positive k such that /cAq < T, if we let s = Aq and 
t G [fcAo, (fc + l)Ao], then we have 

/3 



|y1o,(;c+i)Ao,co < 2|y|Aol + CeblUAS 



This implies 



|y1o,feAo,oo<C(2'^-l)e||5l|/3A^, 
In the equation (4.29), if we let 



(4.29) 



k = [T/Ao] + 1 < 2T/Ao < 2T/Ai + 2T/A2 = Cr|1.9ii^ 
Then (4.29) yields 



i/P 



1//3 



|y1o,T,oo < C2^^ll^ll^' e 



(4.30) 
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Therefore we obtain 



lim sup Ix" (t) ~ X* (t)\ =0. 

In the same way as in Step 3 in Lemma 4.2, we can also prove 

lim \\x^ — a;*||i_a = 0. 



(4.31) 



Step 4. Denote 7?^(t) = ^^^(i) - y{t). Then we can write for all < t < T, 

V%t) =- / [b^r) - b*{r) ~ e{hl{T)y{r) + 6:(r)S(r))]dr 
s Jo 



1 



Hence we have 



where 



/3 
h 



[a'{r) - a*{r) - e{al{r)y{r) + al{r)u{r))]dg{r) . 



W{t)-T^%s)\ < h + h 



W{r) - b*{r) - e{bUr)y{r) + b*Jr)u{r))]dr 



[a'{r) - a*ir) - e{a*{r)y{r) + a*^{r)u{r))]dg{r) 



(4.32) 



Using the argument as for /i and from the boundedncss and the Lipschitz 
continuity of the derivative b^ and 6,j, and from the inequality (4.30), we have 
for < s < t < T, 



[b^{r, x*{r) + \y'{r),u%r))y%r) - e6*(r)y(r)] 



+s [6„(r,x*(r) ,u*{r) + eXu{r))u{r) — 6*(r)u(r)] J-dAd?' 

< l' J^ ||6,(r,x*(r) + Ay^(r),u^(r))||77-(r)| 
+ |6,(r, x*ir) + Xy'{r),u'{r)) - bl{r)\ \y{r)\ 

+ \bu{r, X* {r) ,u* {r) + eXu{r)) - bl{r)\ \u{r)\ \dXdr 



< C \r,'ir)\dr + L [(|y^(r)| + e|S(r)|) • |y(r)|] rfr + eL / \uir)\^dr 



Since supo<r<T \y^\ < Ce we obtain 

h < C{t-.s)[U\\s,t,oo+e] 



(4.33) 
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Step 5. To estimate I4 we shall use the consequence (2.5) of the fractional 
integration by parts formula (2.4). Denote 

From (2.5) it follows 



\^eir)\ 



h < cyy-j^ (i_,)i-a-/3(,_,)c 



dr 



-chh- 

£ 



\(Te{r) ~ (Te{T)\ 



(r-r)"+i(f-r)i-«-'3 
Use the same technique as for I^ and I2 to obtain 

h < Cyy {hi + h2 + hs + 144) , 



drdr . 



(4.34) 



where 
hi ■■= 



*{t~r) 



a+P-l 



(r- sY 



a^{r,x*{r)+Xy^{r),u%r))dX-r]%r) 







+ / {<^x{r,x*{r) + Xy%r),u%r))~(T*{r))dX-y{r) 
Jo 

+ / {au{r,x*{r),u*{r)+Xeu{r)) -al{r))dX-u{r) 
Jo 



dr 



t cT 



(t-r) 



Q+,3-1 



s J s 

1 



- ^\a + l 



(r-T) 



a^{r, x*{r) + Ay"(r), u"(r))dA • 77" (r) 



a,{T,x*{T) + Xy'{T),u'iT))dX-7j'{T) 



drdr 



i43 






S 'J s 

1 



(r-T) 



{aAr,x*{r) + Xy'{r),u%r)) - a*(r)) dX ■ y^r) 



ia,iT,x*iT) + Xf{T),u%T))-a:iT))dX-y%T) 



drdr 



144 



{t r) 



,\a+P-l 



s 'J s 

1 



- T\a + 1 



(r-T) 



{auir,x*{r),u*{r) + X£u{r)) -cr,*(r))dA- (ei2(r)) 



{auir, x*{t), u*{r) + Xeu{T)) - ^^(r)) dX ■ (eS(r)) 



drdr . 



We shall use the boundedness of the first derivatives of a. Since the second 
derivatives of a with respect to x and u are bounded the first derivatives of a 
are Lipschitzian. Thus we have 



hi < 



+ 



(r-s)" 
{r - s)" 



77^(r)|(ir 

y'{r)\ + \eu{r)\][\y{r)\+u{r)]dr. 
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Since supo<(<y |y^(i)| < C'e, and u{r) and y{r) are bounded, we see 

hi<C{t-sf[\\7f\\s,t,oo+s] . (4.35) 

In a similar way we have 

l-t i-r u „\a+l3-l 



h2 < 






.., ;. (r-T)"+i 
+ |a;^(r) - x'{t)\ + \u*{r) - u*{t)\ + \u%r) - u^t)\) Irj^T)] drdr . 

By the Holder continuity of x* and u* and unform Holder continuity of x' and 
u"^, which are used to assure the integrability, we obtain (similar to I2) 



I42 < (i-.s)^+i-"h1|i-„,.,, + (t-s)^+'^h^ni 



(4.36) 



/43 and /44 are more complex and can be dealt with in the same way. We shall 
consider 143. First we have 



^43 < -^431 + -^432 , 



(4.37) 



where 



i431 ■ — 



i432 



(t-ry 



i+fi-1 /■! 



a,,{r,x*ir)+Xy%r),u%r))-a:ir)\dX 



(r-r)"+i Jo 
■ \y^{r) -y^{T)\dTdr 

-a.,{T,x*{T) + \y'{T),u'{r))+cj*{T))d\-\y'{T)\drdr. 



By the Holder continuity of y^ and Lipschitz continuity of the first derivatives 
of a, we have 



'431 



< '[ [ ^\r 1^1)^+1 ^^ - ^)'"" [l2^' Wl + =I^WI] ^^ ^ ^^^ - ^)''^'"" 



e. 



(4.38) 



To deal with 1432 wc denote 

a^A,,,W = a;*(0 + A?7y^(r) , it^(r) = 'u*(r) + ?7u(r) . 
Then 

(T^(r,x*(r) + A2/^(r),it*(r) +£u(r)) - (T*(r) 

[ACTa.^(r,a;5^,,,(r),w^(r))y'^(r)+ecr^„(r,x|,,(r),u^(r))M(r)]d77. 
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Hence, 
I432 < 



{r~r)-+^ Jo Jo 



\<^a:xir, xl,^{r),u'^{r))y%r) - a^^^r, x| ,,(r), <^(T))y^(T) 



+e \(Txuir, xl,^{r), u^(r))u(r) - cr^„(r, x^ ,,(t), w^(r))w(r)| 



(iA(i?7 • |y'^(T)| drdr 



By the boundcdness and the Holder continuity of the second derivatives of a we 
have 

/432 < cjj^ \r-rr+i \y'i^)-y'i^)\\y'(^)\dr 

/■* r (t - r)°+^^^ 
A A (r-T)"+i 



(r - ry + \x*{r) - x*{t)\ + \y^r) - y' {t)\ 



+e\u*{r)-u*{T)\ + \u%r)-u'{T)\ 

By equation (4.30), we have 

/432 < Cit - sfe . 
Combination of (4.37)-(4.39) yields 

In similar way, we have 



\fir)\+e\uiT)\ 



|y^(T)| drdr . 

(4.39) 

(4.40) 
(4.41) 



/44 < C{t - sfe . 
The inequalities (4.34), (4.35), (4.36), (4.40), and (4.41) yield 

h < C\\g\\p [it - s)^+i-"||r;^||i„„,,,, + (t - sf^Ut,^ + e{t - sf] . (4.42) 

Step 6. From (4.32), (4.33) and (4.42), we have 

\rit)~v%s)\ < C\\g\\p [{t - s)^+i-"|lrf 111-.,.,* + (t- sfWrfl^^t.o. + e{t - sf] . 

This implies 

h1|i-a,M < Cllffll^ [{t .)^||,f ||i_„,,,, + {t- sf+^-'U\kt,oo + e[t - s)^+"-i] 

Now we can follow the same argument as in Step 3 to complete the proof of 

the theorem. 

Step 7. The L^ convergence is from the Fernique Theorem. ■ 

As we mentioned earlier Lemma 4.4 implies Proposition 4.1 easily. This 

completes the proof for Proposition 4.1. ■ 
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To derive the maximum principle, we need to obtain an explicit solution to 
the equation (4.6). Let us consider the following linear matrix- valued stochastic 
differential equations. 

ni 

d^t) = bUtMt)dt+j:ai^*itMt)d°Bfit), 

j=i (4-43) 

$(0) = /, 

From the basic stochastic calculus for fractional Brownian motions (see e.g. [22]), 
it is clear that this equation has a unique solution, denoted by $(t). It is easy 
to verify that $~^(t) exists and is the unique solution of the following stochastic 
differential equations: 

j=i (4.44) 

$-1(0) = /. 

Again from the Ito's formula we can obtain the solution of the equation (4.6) 
by using $(i) and ^^^{t). 

Lemma 4.5 Let $(t) and ^~^{t) be defined by (4-43) and (4-44)- Then the 
solution to (4-6) is given by 

y{t) = ^{t) f ^-'{s)b:{s)u{s)ds 
Jo 

+ ^$(i) / .p~\s)ar{s)u{s)dBf{s), (4.45) 

5 Maximum principle for stochastic control of 
system driven by fractional Brownian motion 

Recall that we defined the space of admissible controls in Section 4, 

t/[0, T] := I u\u : [0, T] X rj ^ R'', u is ^-adapted, u G C^[0, T] for some fi > 1 - H , 

there exist constant C > 0, c > 0, and (3 < H 
such that ||u||^,o,T < 06"^^=! WBfh.Q.T 

and / / E(|i:»fii(t)p)dsdt < oo i . (5.1) 

It is clear that U[0,T] is a linear space. 

Let b : [0, T] x E" x R'^ ^ R", a : [0, T] x R" x M"* -> M"^"', be some given 
continuous functions satisfying the assumptions (H4) and (115) given in Section 
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4. Consider the following controlled system of stochastic differential equations 
driven by fractional Brownian motions: 

rn 

dx{t) = b{t,x{t),u{t))dt+Y.'^Kt,<t),<i))d°Bf{t), 

i=i (5-2) 

a;(0) = zo . 

Here the integral with respect to fractional Brownian motion is the Stratonovich 
integral. Some properties of this controlled system are given in Section 4. 

Let Z : [0,r] X M" X R'' ^ R and /i : R" ^ R be some given functions 
satisfying the following conditions. 

(H3) / and h are continuously differentiable with bounded derivatives. 

The cost functional we use in this paper is given by 

J{u{-))=eI I l{t,x{t),u{t))dt + h{x{T))\ . (5.3) 

Assume j > 1 — H. Let a E {1 — H, oq) and p > 1/a, where 

. fl 

ao = nim <^ - , 7 

From the conditions (H4)-(H5) the controlled stochastic differential equation 
(5.2) has a unique solution (sec e.g. [17], [28]). Moreover for P-almost all 
we n,X{uj,-)e Cl-"(0,T,7^'^). So assume that \x{r)~x{T)\ <co\r^T\^~" in 
probability. The solution .t" of above equation depends on u. But to simplify 
the notation we often omit its explicit dependence on u and write Xt = x". 

Now our optimal control problem can be stated as to minimize the cost 
functional over U[0,T]. That is to find optimal control u*{-) G U[0,T] such 
that 

J(ii*(-))= inf J{u{-)). (5.4) 

u{-)euio,T] 

Let u*{t) be an optimal control and x*(t) be the corresponding solution of 
equation (5.2). (.t*(-), «*(•)) is called an optimal pair. 

Wc will find a necessary condition that the optimal control u*{-) must satisfy, 
which is also called the maximum principle. 

5.1 Stochastic control with partial information 

Since u*{-) is an optimal control and since the space U[0,T] of admissible con- 
trols is linear, we have that u*{-) is a critical point of nonlinear functional 
J(u(-)), u e C/[0,r]. This means that 



±Jiu*{-)+su{-)) 
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= 0. (5.5) 

e=0 



We will follow the same idea as in Section 3 for the Brownian motion case to 
deduce a necessary condition from the above equation (5.5). As in Section 4, we 



denote v(r) = lim 
Theorem, we have 



-J{u*{-)+sui-)) 



By Lemma (4.4) and Dominated Convergence 



= E 

e=0 "'o 



{lfit)y{t)+lf{t)uit)) dt + E[hl{x*{T))yiT)] 



Substituting (4.21) into (5.5) we obtain 



-Jiu*i-)+eui-)) 



= E / (ifmit) [ <i>-'is)b:{s)uis)ds + IV {t)uit) ] dt 

e=0 Jo \ 

T 







+ f2^£ (lfmit)J^^-H-^M*{s)uis)d°B^is)^ dt 
+ f2KUlix*{T)MT) l\-\s)ar{sMs)d°Bf{s)\ 



II' {t)^{t) ) dt^-'{s)hl{s)u{s) ) ds + E / II' {s)u{s)ds 



T 



+E / hl{x*{T))^{T)^-\s)bl{s)u{s)ds 
Jo 



f;^ (ElfitMt)J^ {^-\s)arisMs)d°Bf{s)) ds^ dt 
J2^lhl{x*{T)MT)J^ <^-\s)ar{s)u{s)d°Bf{s)\. 
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The expectation of the above last two terms can be computed by the formula 
(2.19). Thus, we have 

-fj(u*(.)+eS(.)) 

T' / T' \ T' 

= E /" j /" l*J{t)^{t)dt\^-\s)bl{s)u{s)ds + E f l*J{s)u{s)ds 

i-T 



E / hUx*iT)MT)<^-\s)bUs)uis)ds 







-E^ 



j=i 



{ifmm~\s)<jr{s)}u{s)dt 



ds 



rT i-T 



Y^E / lf{tMm'Hs)arism{u{s))dtds 

j^^ Jo Js 

m „T 

+ ^E / V>i{hl{x*{T)mT)^-\s)ar{s))u{s)ds 



j=i 



Y^E / hl{x*{T))^{T)^-\s)a^^*{s)WAu{s))ds. 



Since the equation (5.5) holds true for all adapted process u in [/[0,T], we can 
choose especially u{s) = ![„,&]«, where < a < & < T and u which is Qa 
measurable. Then from (5.5) and the above computation it follows 

E f I f rJ{t)^{t)dt]'^-\s)bl{s)uds + E f rj{s)uds 



+E I h^{x*{T))'^{T)<i>-'{s)bl{s)uds 
rb / rT 



{/;^(i)$(i)$-l(s)<-*(s)} 



+ ^E 
-^e/ / lf{tMm-\s)ar{sM{u)dtds 

7 = 1 •^'^ "^^ 



Idt ds 



i=i 



^E / Bi {h'^{x*{T)MT)^-\s)ar{s)) uds 



-5]E / hJ{x*{T)MT)^-'is)ar(.sM{u)ds = 0. 

.7 = 1 •'" 
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We can use the formula (2.17) to compute the above two terms involving ©Iw. 
we have then 



lfm{t)dt]<i>~'{s)bl{s)ds+ / l*Jis)ds 



+ I hUx*{T)MT)<^-\s)bUs)ds 

™ pb / pT 



■E 



{ifmm-\s)ar{s)} 



dt ds 



m „(, 



+E 



dB"{s) 



m „b 



rjmm~\s)ar{s)dt 

lit pQ 

J2 / n{hI{^*{T)MT)'P-\s)ai;*{s))uds 

^ / hJix*iT)MT)^~\s)ans)dBfis 

Since the t/^ measurable u is arbitrary, we have 

Theorem 5.1 Let u* he the optimal admissible control. Then u* satisfies the 
following 

E 



™ fb r fT 



ifmit)dt^-\s)b:{s) + if is) + hj{x*{T)MT)<i>-\s)b:is) ds 

{lfmm~\s)a'u*{s)}dt 

+Bi{hj{x*{T)MT)^-\s)<ji;*{s)} ds+Y, / ifmm-Hs)<ji;*{s)dt 



E 

3 = 1 -"^ 



-;.J(.T*(r))<i>(T)$-i(s)<-*(s) 



dBf{s) 



Ga 



= 0, VO<a<fe<r. 



Remark 5.2 Using pathwise integral, we can write the above equation as 



E 



m rb r rT 



E 



/:^(i)$(t)di$-^(s)6:(s) + z:^(s) + h]:{x*iT)MT)^-\s)b:is) 
rjmm-\s)ar{s)dt 

hJ{x*{T)MT)<^-\s)a^^*{s)\d'^Bf{s)\g, 



(5.6) 



ds 



0, y 0<a<b<T. (5.7) 
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5.2 Stochastic control with complete information 

Now we assume that the filtration Q = T and note that it is also the filtration 
generated by the (background) defining Brownian motions W . Namely, 

Tt^^ {B^{s) , • • • , Bfjs) , 0<s<t)=<y{Wi{s),--- , W™(s) , < s < t) . 
We shall simplify the equation (5.6). Denote 



FiT,s) ^ (/ 






FiT,s) = FiT,s)+J2nG,{T,s). 
Then the equation (5.6) can be written as 



m „h 



E 



/ F{T,s)ds + Y, / G,iT,s)dBf{s) 



^a)=Q- (5.1) 



We shall simplify the above equation (5.1) in the case of complete information. 
To this end we need some lemmas. 

Lemma 5.3 Let 1/2 < H <\, and e > 0. Denote 

p{e)= / {t- sf"-'^si^"ia-s + ey"-hi-"{a-t + ey"-^dsdt. 

Jo Jo 

For any S € (0, 2 — 2iJ), there exist Cg > 0, depending on H,a and 5 hut 
independent of e, such that 

p{e) > Cse'-^"-' . (5.2) 

Proof Without loss of generality, we prove the case when a ~ 1. 

We choose some 6 e (0, 2 - 2H), and we have \t - sp^-2(l - s + e)^ = \t - 
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.\2H-2+8fl-s+e\S 



s\-' - ' "(-4^)'^ > 1, when < s < < < 1. 

^2H-2^k-Hth-H^l _ , + e)-"-"^{l - t + e)-"--^dsdt 

\t - s{^"-''{l - s + s)-"^^l - t + e)-"-idsdt 



r-l /.I 

/o Jo 

=2/ / \t-s 
Jo Jo 

^0 Jo 

Jo Jo 



=C 



=c 



(l-t + £)^-"-''-(l + £) 



i-_ff-(5 



(l-< + e)"-^"^dt 



1 



_l-2ff-<5 



2if + (5 - r 

£1-2^-^ as e ^ 0. 



(1+^) 



1-2H-S-I 



H-\ 



[e-"+h-{l + e)-"+-^\{l+e)'^-"A 



Lemma 5.4 Let Xt be a Gaussian random variable with mean and variance 
f'^{t). If luiif^o f{t) = 00, then linit_^o l-'^tl ~ 00 in probability. 



Proof We have 



E{e-\-^\) 



< 



27rjo 
2 



e-ZW^e-'^dx 



e-f^^^'-'dx 







2^ fit) 



This imphes that \mit^f)E{e l'^*') = and hence e I''*-*' goes to in V-. Con- 
sequently, we have hm^-^o 1^*1 =00 in probabihty as i -^> 0. ■ 

Lemma 5.5 Let g be continuous on [0, T] and let fj , j = 1,2,- ■ ■ ,m be Holder 
continuous on [0,T] of order p with p > I — H. Assume that the Malliavin 
derivative D;^/j(i) is continuous in s ^ [0,7"] for all t G [0, T] and assume that 
sup ni¥.[fj{t)\Ft] < 00 almost surely for all t e [0,T]. // 

0<s<T 



m „(, 



E' 



/ g{s)ds + Y. fA^)d°Bf{s) 

•J a '} — ! *^ 



J"a>=0, V0<a<5<r, (5.3) 



then for all j = 1, 2, • • • , m, 

E[/j(a)|J-,]=0, V 0<a<r. 



(5.4) 
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Proof 

Step 1. Let £ > and 0<a<a + e<T. The equation (5.3) can be written 

as 



E 



Ta 



/ g[s)ds + Y. [Ms)-fj{a)]d°Bf{s) 

J a --y J a 

rn 

+ ^E{/j(a) [Bf{a + e) - Bf {a)] | J-„} = 
Let < [3 < H such that [3 + p > 1. Then from (2.5), it follows that 

'[./.(•^) -/.(«)] rf°Sf(^) < \\Bfy,o,Te^+r 
Dividing (5.5) by e^ with < H' < 1, then we have 

m 

i™o ^ 5Z ^ {/^(«) [^f (° + ^) - ^f W] \^-} 



(5.5) 



i=i 



= 0. 



(5.6) 



It is maybe possible to compute the above expectation in an easy way. But 
instead of developing a formula for above conditional expectation we shall use 
the results from [14]. First, we have 



a+£ 



Ma)dBf{s) = f,{a) [Bf{a + e) - Bf{a)] - I Di/,(a)ds 

J a 

By the continuity of Ds/j(a), (5.6) implies 

\im^^Y.^\ fjia)dBf{s)Ta\^0, Vae[0,T]. (5.7) 

Step 2. Let us recall some notations in [14] (see Equations (5.21), (5.34), and 
(9.22) of [14]). 



KH 



dt 



and 



^HAt)I{t) = VH,XH.Tl{t) 
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Then from the equation (9.21) of [14], we have 



E 



a-\-e 



fM)dBf{s) 



Ta 







Pff,„(.s)E [l[a,a+e](s)/,(a)| -F„] dsf (.s) 



i-ff 



k as 

T 



{^-s)^-''lf-"-{H-^)KH^ 



h-H 



= Cl C{a,e,s)E[f,{a)\J^a]dBf{s) 



d7] \ dBf{s) 



CE[f,{a)\Ta] / C{a,e,s)dBf{s)-C C(a,£, s)©i (E(/,(a)|J-,]) ds , 
Jo JO 

(5.8) 



where 



ds Js [J a 

Step 3. This function C can be calculated as follows. 

7 ra+e ca 



dr\ . 



C{a,e,s) 



,-H 



ds 



{ri~st^-"{(,-i^)"-'H"---di^di 



1 d f""^^ I f^ 1 3 



{v-s)^-''{^-vf-^d^je-^d^ 

d r+' /•«, 



-H 



ds 



(,, _ s)5-^(e - r])"-idi]S,"-^d£, 



A-H 



a J a 

a+e fS, 



e"+hs^-" 



Choose 7 S (0, 1). Dividing (5.8) by e'^ , we see 



a J a '-' 

' (7/e'£ + a-s)-^-^(l-77')^-^^'^-^ 
Jo 



limVE[/,(a)|J-,]- / C(a,£,s)di?f(s)=0. 
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But 

and hence 
^(^^ j\{a,e,s)dBf{s)^ 

JfO,!]* Jo Jo 
2 

X n(l - Vif-kf'hC.e + af-idmd^idmd^2 

i=l 

>Ce2^+i-27 [ r r \t - s|2ff-2s4-fft^-«(e + a - s)-^-«(e + a - t)----"dsdt 
J\o.i\^ Jo Jo 



[0,1]* "'0 "'0 
2 

X l[{l - V^)"'kf~h^^e + af-"-dijidiidmdi2 

2H+1 — ^+1-2H-<S 



We may choose 7 £ (0, 1) and S & {0,2- 2H) such that 2 - 27 - 5 < 0. From 
Lemma 5.4 we see that 4^ /„ C,{0'^ £j s)dB^ [s) converges to 00 in probabihty as 
e ^- 0. This imphes that E \fj{a)\J-a] = a.s.. ■ 
Then wc have also the fohowing lemma. 

Lemma 5.6 Let g be continuous on [0, T] and let fj , j ^ 1,2,- ■ ■ ,m be Holder 
continuous on [0,T] of order p with p > \ — H. Assume that the Malliavin 
derivative fS>lfj{t) is continuous in s £ [0,T] for all t G [0,T] and assume that 
sup W^¥.[fj{t)\Ft] < 00 almost surely for all t e [0,T]. // 

0<s<T 

EM 5(s)ds + ^/ /j(s)<iSf (s) J"a > =0, y 0<a<b<T, (5.9) 

J a j_^ J a I 

then for all j = 1, 2, • • • ,m, 

E[/j(a)|J-,]=0 



and 

for alio <a<T. 



E[g{a)\J^a]=0 
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Proof The first equality is obvious from tlie previous lemma. Now we prove 
the second one. For any e > 0, 



E 



a-\-e 



f,is)dBf{s] 



Ta 




f (f-^^{i - n)""-'^^ [l[a,a+e](0/.(e)|-^a]) di d^\ dSf 

PH.a(s)E [l[,^,+,](s)/j(a)| Ta] dBf{s) 



is) 



[^"-H^-Vr-'^^[^[Ma,a+eii)fM)\H^oW)d^ 

=0, 
then we have 



dr^ \ dBf{s) 



E 



and hence 



[/ g(s)ds|J-a]=0,V£>0, 

J a 

¥.[g{a)\Fa\=Q. 



Wc apply Lemma 5.6 to the equation (5.1) and obtain 



and 



for all < i < T. Denote 



E 



G,{T,t) 
'F{T,t) 



Tt 



Tt 



= 0, 



(5.10) 
(5.11) 



p{t) = {yy\t) 

Vit) = (cI>T)"\t)E^* 



$^(s)C(s)d5 + $^(r)/i,(:E*(r)) 



<^'^{sX{s)d, + <^^{T)h,{x*{T)) 



Then the equations (5.10) and (5.11) can be written as 

771 

and 



(5.12) 



(5.13) 
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m 

b*J{t)p{t)+i:{t)+Y,^[BlG,{T,t)\Tt\=0, VO<i<T. (5.14) 



j=i 



Now wc compute E 



haveE 



DlG,{T,t) 



Tt 



[D^G,(T,t) 



Tt 



Unlike in the classical case, which we 



- nJ 



D{\ 



Gj{T,t) 



Tt 



, now we usually have E 



G,(T,t) 



n^i 



Tt 



+ 



U^E 



Gj{T,t) Ft ■ We need to use (2.21). Let ci,h be a constant as defined in 



k-Hl-i r.l2H-2 



proposition 2.4 and ^i,_ff(s,t) = ci,HS 2 ^\t — s\ ^. Then 



E 



G,(r,i) 



H^^ 



Tt 



0i,h(^-s) — 
\ «s 



(r-s)^~-^r^~^] 



DiG,{T,t) 



Tt 



= /i + /2 , 



dr ds 

(5.15) 



where 



h 



H^H-i;l 



ff(*--^)(^/ (r-s)"«r«-2E DlGj{T,t) 



J"t 



dr ds 



0i,H(t-s) - / (r-s)^-^r«-^E DiG,{T,t) 

V "* "'tVs 



-Ft 



dr ds . 



Using Proposition 1.2.8 of [27], we have 



h 



VasJs 

VasJs 

t / J rt 



-"r"-^^Dm 



-HrH-kom 



G,{T,t) 



Tt 



dr ds 



Tt 



f '^i-«(^-^)(^/ ir-s)i~''r"-iDi{p{t)ai;*{t))dAds. 



dr ds 



I2 is computed as follows 
I2 = 



'^4>iM{t-s) [^ r {r - s)i-"r"-iE\Di {P{t)arit)) 
V "S Jtvs *- 



Tt 



(5.16) 



dr ds 



'.-HH-h, 



<^r(t) r^Mt--'^)!^ r {r^sr^-"r"-iE DlP{t) 

Jo \ "'5 JtVs 



Now let us discuss p{t) . First we have 



•Ft 



dr \ ds . 

(5.17) 



p(i) = ($^) '(t)E 



.Ft 



$^(s)C(s)ds + $^(r)/i,(x*(r)) 



{^^)-\t) f $^(s)C(.)ds 
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r^t 



/g 'i''^ {s)l*^{s)ds + $^(T)/i^(a;*(T)) ,0 < t < Tj is a square inte- 

grable martingale with respect to the fihration J^t generated by the standard 
Brownian motion W, we have 



£■ 



J^t 



$^(s)/;(s)ds + $^(T)/i,(a;*(T)) 



.7 = 1 -^0 



where the introduction of the factor — $^(s) is to simphfy the equation obtained 
subsequently. Therefore, 



Pit) = -{^^)- {t)Y, ^^{s)q,{s)dW,{s)-{'i^)- (t) ^^{sK{s)ds. 



Denote 



and 



A= / ^\s)i:{s)ds. 

Jo 



Then by Proposition 2.7 and equation (4.44), we have 

dp{t) = d<^'^^-\t)-Kt + ^'^^-\t)-dKt-d<^'^'-\t)-A{t)-^'^'-\t)-dA{t) 
= -b*J {t)p{t)dt - i;{t)dt - (j*J {t)p{t)d° B" [t) - q{t)dW{t), 



It is clear that 



p{T)^K{x*{T)), 



Therefore, p{t) satisfies the following backward stochastic differential equa- 



tion 



dp{t) - ~b'f{t)p{t)dt - ll{t)dt - a*J{t)p{t)d°BH{t) + Y.7=i qj{t)dW,{t) , < t < T 
[piT)^h,{x*iT)) 



(5.18) 






Or 



piT)^Kix*iT))+J^ [b*J{s)pis)~i:is)]ds+J^ a*J{s)p{s)d°B"{s)+j^ q,{s)dW,{s) . 

Combining (5.14), (5.15), (5.16), and (5.17) wc have 

Theorem 5.7 Let the assumptions (H4-) and (H5) be satisfied. If{u*,x*) is an 
optimal pair of stochastic control problems (5.2)-(5.4)- Then {u*,x*) satisfies 
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the following system of equations. 



dx{t) ^h{t,x{t),u{t))dt+ J2 cr^it,x(t),uit))d°B"{t). 
x{0) = xo ; 



dp{t) = -h*J {t)p{t)dt - ll{t)dt - a*J{t)p{t)d°B"{t) + E7=i qj{t)dW,{t) 
p{T)^K{x*{T))- 



E"i'^i*^WpW=0; 



(5.19) 



*J{t)p{t) + im + /„* 0i,H(i - s) (A /;(, _ s)-^-"r"-'^Dl (pityrit)) dr) ds 
+^i'*(i) lo 'PiMit - s) (A J^^^ir - s)i-"r"-^E [DiP{t)\Tt] dr) ds = , 
where 



p{t) = {^^y (t) 



$T(s)/:(sKs + $T(r)/i,(.T*(r)) 
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